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SUMMARY 



Problem - 

As part' of the evaluation of PLATO IV technology, this effort was 
planned to study ways to take advantage of the terminal graphic dis- 
play ""capabilities, for computer-^based instruction. The research spe- 
cifically examined how verbal instruction (text) for learning the 
sine-ratio concept could be supplemented by Visuals (graphic display; 



Background 



A searqji of the computer-assisted instruction (CAI) literature 
revealed no systematic study of the effects on concept learning 
of graphic supplementation of verbal instructional material. The 
few recent 'studies of this question .outside the CAI field were ^f 
little help. The most comprehensive study, that of Dwyer (1971), 
concluded that verbal instruction should] be used without graphic' 
supplementation in learning the structural-functional concepts of 9 
topic. • V 

Approach 

Three versions of a lesson on the sine-ratio concept were prepared, 
one in which verbal text was supplemented with animated graphics, one 
with still-graphics, and one without graphics (text-alone). Forty-five 
students from the Basic Electricity/Electronics School at., the Naval 
Training Center (NTC>, San Diego, were randomly assigned to the three 
- versions. The hypothesis was that the animated graphics groups would • 
have a higher mean post;test score than the still-graphics group, and 
the still-graphics group a higher mean score than the text-alone group; 

Findings and' Conclusions 

A comparison of the pretest and posttest mean scores for each^ group 
revealed that learning took place in each group. On a questionnaire 
administered after the posttest, student ratings of the instructional 
material and presentation were highly positive. However, th^re was 
no significant difference between the mean posttest scores for the 
three groups. Students apparently learned as much about the sine- 
ratio concept from text alone^ as from text and still graphics or 
text and animation. Failure to find that graphics supplemented the 
learning and comprehension of a verjb^l concept involving space appears 
consistent with the literature. Cateiul format and sequence presenta- 
*tion of text and graphics on the PLATO plasma screen may be necessary 
to avoid producing simultaneous or competing attending behaviors. 
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INTRODUCTION 



The PLATO system is outstanding among computer-assisted instruction 
(CAI) systems for its capabilities in presenting complex graphic images, 
a fact that is well documented (Bitzer, et al, 1970; Lyman, 1974). How- 
ever, a search of the literature has revealed no systematic study of where 
and how to best apply these graphic capabilities for pedagogical purposes. 

In a broader context, several researchers have recently studied the 
possibility of supplementing verbal instruction with visuals. Gorman 
found no significant differences when using simple line drawings or shaded 
line drawings when students were asked to identify exemplars of a concept 
(Gorman, 1973). . Strang (1973) found that the leafning of a typical voca- 
tional skill from a series of 35mm slides was enhanced by the addition of 
verbal instructions. Wells and his associates (1973) found that motion 
pictures were more, effective than a sequence of slides or still pictures 
in teaching concepts involving time or motion, although there were no 
significant differences for learning concepts involving space. 

The most comprehensive of recent investigations of methods of com- 
bining text and visuals for effective teaching was done by Francis Dwyef 
(1971). The study evaluated various ways to teach the structure and 
function of the heart. One group of students received oral instruction 
without any visuals. Other groups received the same oral instruction 
supplemented with illustrations of various types — i.e., simple line 
drawings in black and white (b/w) or color, detailed shaded drawings in 
b/w or color, and photos of an actual heart in b/w or color. Corresponding 
to different educational objectives, the students were given four criterion 
tests, a verbal-picture drawing test, a verbal-picture identification 
test, a verbal terminology test, and a verbal comprehension test. Sig- 
nificant differences were found between groups on the drawing and iden- 
tification test scores. However, the terminology and comprehension test 
scores revealed that the oral presentation, without visuals, was as effec- 
tive as the treatments with visuals. Dwyer concluded that the verbal 
instructions could be used without visuals for comprehending the struc- 
tural-functional relationships in the topic. Learning content and subject 
population limitations in Dwyer's study should be noted and justify continued 
research on facilitation of training with visuals. 

The present report describes an investigation Of where and how to 
best apply graphic capabilities for learning in a CAI context. Three 
versions of an instructional lesson on the sine-ratio concept were com- 
pared. The first version comprised text and animated graphics, the second 
used the same text with still graphics, and the third used the text alone. 
The hypothesis was that performance on a posttest would be progressively . 
degraded as the visual supplements were removed. 
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METHOD 



Subjects , ^ / 

All subjects were students attending the Basic Electricity and Electron- 
ics School (BE&E) at the Naval Training Center (NTC), San Diego, California. 
The curriculum was an individualized course of instruction broken down 
into 14 modules. Trigonometry was not encountered by the student until 
he reached Module 12; consequently, a student was not eligible for par- 
ticipation in the CAI experiment if he had begun, that module. The only V 
other constraint on selecting a subject was that he had not had trigonom- 
etry in high school. 

The Sine-Ratio Lesson and Tfest Materials 

The overall training objective of the sine-ratxo concept lesson was 
that the*subjects should be able to coii5)rehend the sitle ratio to the 
point where they could (1) use the fotmula, sin 0 » along with a 

table of sines to calculate the value R and (2) transpBse this formula 
on the ba;5is of the fact that it was an equation. The sine-ratio training 
materials were broken down into the following subconcepts: (1) right 
triangle,. (2) ratio, (3) sine ratio, arjd (4) ^equation. A multiple-choice 
criterion test of 26 items was .written,j and each test item was visualized 
as fully as possible — i.e., the basic graphic images were laid out, with 
particular attention focused oiPthe sequencing of change (animation) in 
their configuration. The text of the instruction, for the most part, 
consisted of simple declarative sentences written in answer to each test 
item. ♦ 

Twenty-nine instructional' displays were produced. There was one 
display for each of the 26 test items plus three found to be necessary 
for smooth transitions. The 29 displays comprised the first version of 
the lesson; the second version used the same text and key graphics without 
animation; and the third eliminated all graphics and served as a text-alone 
control. 

The same criterion test served as both the pretest and the posttest, 
the only difference being in the order of the four possible choices of 
answers for each question. Table 1 shows samples of the way the informa- 
tion was presented in each version of the lesson. 

! 
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Attitude Questionnaire 

A questionnaire, designed to register the student 's^ attitudes toward *^ 
the CAI experience, was filled out by each^subject before he returned to 
the BE&E School. It contained 41 questions divided among several topic 
areas: (1) PLATO terminal operating instruction, (2) typing problems, 
(3) clarity of the image^ on the plasma screen, (4) the moveable keyboard, 
(5) instructional ""effectiveness of the lesson, and*(6) general appraisal 
of compuder-based instruction. 

Apparatus f 

/ 

^kll lemons arid tests were mediated by the PLATO IV computer-based 
education systdm, the hardware of whi(!!|lhas been described by Stifle (1972). 
Student terminals in San Diego were connected to the PLATO system at the 
^University of Illinois. The training materials for the s4ne-ratio lessons 
were displayed on an 8-inch square plasma screen. Progress through a 
lesson waj controlled by t!^ student^ who used a keyboard adjacent to the 
panel. 

Design and Procedure 

Forty-five subjects were randomly assigned to one of three treatment 
groups — (1) Text and Animation, (2) Text and Still Graphics, and (3) Text 
Alone. The pretest and posttest were identical for the three groups. 

^ Implementation ot the experiment can be broken down into the following 
stages: . ' , 

1. Computer Specialists coded the pretest, the three versions of instruc 
tion, and the posttest in TUTOR language for display on the PLATO IV computer 
based instructional system. 

2. Each of the 45 students from the BE&E School were randomly assigned 
to oAe of the three versions of the lesson (15 to each version). 

3. The student controlled the pacing of the displays by a keyboard, 
the use of which was explained to^^him in a brief introductory lesson. 

He had the option of repeating the viewing of each of the four sequences, 
(subconcepts) that comprised the lesson. He did not have the option to 
repeat an individual display (unit). 

4. The PLATO system recorded the stuflents' answers to pretest and 
posttest questions and kept a tally of right answers. Latencies for test 
items and units of instruction and the sequence in which the student viewed 
the displays were also recorded. 

5. Student. performance data was assessed and displayed on the PIJ^TO 
screen by the experimenter for analysis. 



RESULTS 



Gain Score Means 

An analysis was made of the gain scores to determine whether the 
instruction produced an improvement in performance. Table 2 shows the 
pretest-posttest mean gain scores and their standard deviations. One 
score in Group 3 vas lost and reduced n to 14 for that group. With a 
null hypothesis that the mean gain score equalled zero, the t-tests showed 
that learning took place between the pretest and postt^st in each of the 
three groups. 

TABLE 2 

Mean Gain Scores and T-Tests 





Group 1 


Group 2 


Group 3 




Text & Animation 


Text & Still Graphics 


Text Alone 


n 


15 


15 


14 


M 


15.36 


15.76 


14. 


SD 


7.83 


11.99 


11.91 


t 


7.60* 


5.09* 


4.58* 



*p = < .001 



Analysis of Covariance 



Table 3 shows the mean scores for three measures of a student *s back- 
ground—the GCT, ART, and the sine-ratio pretest—for Groups 1, 2, and 
3. An analysis of covariance was performed to adjust the posttest scores 
for differences on the three background measures resulting from the random 
'Assignment of subjects to groups. 
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TABLE 3 

Mean Scores for Backgraund Measures 







Group 1 


Group 2 ^ 


Group 3 


Text 


&' Animation 


Text & Still' Graphics 


Text Alone 

V 


Classification 
"^Cest (GCT) 


57.8 


55.2 


55.0 


Arithmetical 
Reasoning 
Test (ARI) 


54.8 


46.8 


49.0 


Sine-Ratio 
Prfetest " 


71.8 


62.9 


67.4 


Table 4 lists the correlation 
against the inean posttest scores 


coefficients of the background measures 
for each group* 






TABLE 4 






Correlations of Background Measures 
With Posttest Performance 








Group 1 


Group 2 


Group 3 


Text 


& Animation 


Text & Still Graphics 


Text Alone 


General 

Classification 
Test (GCT) 


.30 


.40 


.40 


Arithmetical 
Reasoning 
Test (ARI) 


.29 


.03 


.45 


Sine-Ratio 
Pretest 


.61 


.35 


.37 



14 

8 



• Table 5 shows the posttest and adjusted posttest means. Although 
the animated graphics .group appeared to have scored higher than the other 
tgroups, the differences were not signif icantj. The power of the F-test ^ 
(Myers, 1972^ against. an alternate hypothesis of three points difference^* 
Between 'groups, was approximately .40 for a « .05; thus, small differences 
were not likely to be^ detected. 



TABLE 5 
Adjusted Posttest Means 



Group 1 Group 2 Group 3 

Text & Animation Text & Still Graphics Text Alone 



i Posttest ^ A 

Mean • 87.1 78.7 81.0 

Adjusted _ o-t n 

Posttest Mean 85.3 80.3 ^-^-^ 

Adjusted ' o o ^.0 

Standard Error 2.3 2.2 

Covariance analysis F(2,39) =1.22 
Mean Times 

The mean total time required for each group of students to go through 
the instruction and the posttest is shown in Table 6. A computer program; 
malfunction during data collection lost two data points in Groups 1 and 3, 
and one data point in Group 2. The differences between groups were not 
significant. The power of the F-test, against the alternative hypothesis 
that the groups would vary by more than 5 minutes, was approximately .50 
for a =» .05. 

Table 7 gives the correlations of mean instruction and posttest times 
with means of the background measures. Note that only in Group 2 were 
the GOT and ARI scores good predictors (.64 and .61) of the time a student 
would take to complete Instruction and the posttest. 
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TABLE 6 

1 

Mean Total Times in Minutes 
for Instruction and Posttest 



Group 


1 


Group 2 


Group 3 


Text & Animation 


Text & Still Graphics 


Text Alone 


n IjJ 




14 


13 


M 37.6 




33.1 


35.7 


SD 12.9 




8.1 


13.2 


F,(2,37) = 0.50 








Correlation of Mean 


TABLE 7 ' 
% 

Times with Hack^ptound Measures 




Group 1 


Group 2 


Group 3 


Predictor Text & 


Animation 


Text 5e Still Graphics 


Text Alone 


General 

Classification 
Test (GCT) 


.02 


.64 


.13 


Arithmetical 
Reasoning 
Test (ARI) 


.01 


.61 


.08 


Sine-Ratio 
Pretest 


.22 


.13 


.28 



/ 



ERIC 



10 



Student Attitudes 

Student rating of the instructional materials and their presentation 
was definitely positive. Table 8 shows the questions asked and the fre- 
quency with which each rating was chosen. five-step scale was used 
on three basic dimensions — poor to outstanding, 0 to 100%, and never to 
always. 
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TABLE 8 

Student Ratings of the Training Materials 



Question 


Selection 


of ^Ratings (n= 


=41) 


Mean Rating 




1 2 


3 4 


5 


Rate the instruc- 
tional effectiveness 
of ^hp f'Tfl.i.ninp 

materiali^ 
(poor-outstanding) 


0 3 


5 22 


11 


4 


How well did you 
understand what 
you were siipposed 

(0-lOOZ) 


2 2 


7 21 


9 


f ■ — 

3.8 


The instructional 
material was pre- 
sented too quickly — 

Steps 

(never-^always) 


21 15 


2 2 


1 


1.7 


Too much material 
was presented at 
one time on the 
screen 

(never-always) 


1 30 8 

1 

j 


2 1 


0 


1.4 


Arrangement of the 
material on the 
screen was 
excellent 
(never-always) 


1 . 0 


1 15 


23 


4.4 



DISCUSSION 



The Data 

Although the perf orm-^nce pf the animated graphics group appeared 
highest, analysis of post test mean scores showed no differences between 
groups. The data appear to show that a student could learn as much about 
the sine-ratio concept from text alone as from a combination of text and 
still or animated graphic?. It is possible that the learning task employed 
wa? not sufficiently difficult to be sensitive to the effects of graphics. 

The degree of learning in the text-only group may have been a reflec- 
tion of the careful preparation which went into the development of those 
materials. Also the pre- and posttest questions were heavily weighted 
verbally and lacked dependence on visual graphics, thus making the learning 
task similar to the verbal terminology and verbal comprehension conditions 
in which Dwyer (1971) failed to find graphic facilitation. 

Another explanation for failure to find differences between the experi-* 
mental conditions is that trainees attending the BE&E School may have been ^ 
accustomed to using verbal labels for the mental images of straightline, 
angle, triangle, etc. Graphic representation of these images would, there- 
fore, have been superfluous or even a distracting redundancy. Graphics 
Alight be demonstrated to be more useful in the learning of more spatially 
complex concepts. ' 

Possible Effects of Instruction System Delivery Constraints 

Two major PLATO system constraints may have resulted in decreasing 
the influences of the experimental variables during the study. ,These 
constraints are: (1) the temporal and spatial manner in which text and 
graphics are generated on the display screen, and (2) the absence of audio 
capability at the time the study training materials were being developed. 

The PLATO system takes a noticeable amount of time to generate a display 
on its plasma screen. The letters of the text come up in a series, so 
text is displayed from left to right and down the screen. The lines of 
the graphics are generated from source to terminal points and look as if 
they are being drawn as they make their appearance on the screen. Though 
this process is fast, blocks of text or complete graphics cannot be gener- 
ated on the screen instantaneously as with motion pictures or television. 

Audio might have prevented problems with integration of text and 
graphics. Had audio been available, the pacing of ^a student's viewing 

the stimuli might have been better controlled. Tor example, appropriate 
pauses in the narration could have allowed verbally coded information to 
be repeated or supplemented with graphic coding. Without audio, the time 
allowed for reading a block of text could not guarantee that the display 
of an associated graphic would not act as an interruption or distraction 
in the form of a competing visual stimulus. 
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For inost of the unit displays, the preceding constraints resulted 
in putting graphics and text on the screen as fast as possible and allowing 
the student to decide whether to examine the diagram or ^ read the text first. 
Occasionally, pauses to allow reading before displaying' a graphic were 
risked. In one case, in Unit 18 of the first version of the lesson (Table 
1), the student had to press a key before the right-triangle would appear 
and animate through a series of right-triangles with decrements or incre- 
ments in the value of 0. 

Since^ these constraints presumably operated in proportion to the com- 
plexity of the graphics supplementing the text, they may have counteracted 
the expected advantages of the animated version over the still graphic 
vetsio^y and the latter over the text alone. 
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